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ABSTRACT 


Both  scheduled  and  replenishment  as-needed  strategies  are  analysed  for 
multiple  resource  systems.  It  is  found  that, in  general  the  most  efficient 
strategies  are  those  for  which  the  replenishment  is  made  with  a  combination 
of  units  most  closely  resembling  the  failed  resources.  In  this  context, 
•most  efficient*  refers  to  the  smallest  expected  unit  replenishment  rate 
required  to  generate  a  given  level  of  continuing  service.  Quantitative 
results  are  given  for  many  cases  of  interest  including  replenishment  with 
multiple  resources  of  different  types.  The  techniques  used  can  be  extended 
to  other  replenishment  strategies  and  failure  models. 


,  The  results  are  particularly  applicable  to  multi-mission  satellite 
systems  and  can  contribute  to  the  economic  analysis  of  such  systems. 
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Multi  mission  satellite  systems  (S"3,  Nq  «4). 

Survival  probabilities  for  periodic  replenishment.  Average 
number  of  active  units  “  4.  Probability  of  successful  launch 
“  .85.  From  Niessen,  Ref.  [2]. 

Survival  probabilities  for  periodic  replenishment.  Average 
number  of  active  units  ■  6.  Probability  of  successful  launch  ■ 
0.85.  From  Niessen,  Ref  [2]. 

State  diagram  representing  Poisson  replenishment  and 
exponentially  distributed  unit  lifetimes. 

Required  average  replenishment  rate  (Poisson  replenishment, 
exponential  lifetime). 

Two  satellite  systems,  N0  ■  4  active  units  required  of  each 
(two  excess  B's  shown). 

State  diagram  representing  independent  failures,  replenishment 
two-at-a-t ime . 

Results  for  dual  replenishments  of  2  systems  with  independent 
unit  failures  (equal  failure  rates):  (a)  Required  replenishment 
rate,(b)  Average  excess  units,  (c)  Probability  both  are  critical 
(d)  Average  run  length. 

Results  for  dual  replenishment  with  independent  failures 
(unequal  failure  rates). 

State  diagram  including  bus  failures  (N^  "  2  active  units 
required). 

Annotated  transition  rates  from  state  (1,  1,  2).  (*  indicates 
replenishment  required). 

Results  for  dual  replenishment  including  bus  failures  (equal 
package  failure  rates).  NQ  “  2. 

Model  representing  replenishment  of  3  systems  three-at-a-t ime . 
(Rates  shown  are  normalised.  States  show  excess  active  units). 

*  ■  launch  required. 

Normalized  replenishment  rate  per  system  for  3  systems. 

Model  representing  replenishment  of  3  systems  two-at-a-t ime. 
(Rates  shown  are  normalized.  States  show  excess  active  units). 

*  ■  launch  required. 


t.  INTRODUCTION 

This  report  examines  several  topics  relating  to  the  replenishment  of 
multiple  resources.  The  general  problem  has  the  following  outline:  It  is 
desired  to  maintain  S  systems  in  operation.  In  order  to  be  considered 
operational  the  s-th  system  must  have  Nq(s)  working  units.  However,  units 
fail  in  a  random,  but  describable  way,  thus  requiring  replenishment.  Several 
models  for  describing  unit  failures  will  be  considered  as  will  several 
replenishment  strategies. 

This  class  of  problem  was  motivated  by  considering  the  particular  case 
of  multi-mission  satellites.  Using  satellite  terminology  the  "units"  of  a 
system  are  payloads  that  must  be  maintained  on  orbit.  A  system  will  also  be 
referred  to  as  a  "mission".  Replenishment  is  accomplished  by  launching 
additional  satellites.  Each  satellite  may  carry  multiple  payloads  to  support 
the  multiple  missions.  Each  satellite  consists  of  a  "bus"  with  support 
equipment  such  as  stabilization  control,  power  supplies,  etc.,  in  addition  to 
the  multiple  payloads.  It  is  assumed  that  each  on-orbit  payload  is  either 
working  satisfactorily  or  has  failed.  If  the  bus  fails  on  a  particular 
satellite,  all  the  payloads  on  that  satellite  are  considered  as  having 
failed.  Thus  multiple  simultaneous  failures  will  be  considered  in  addition 
to  individual  payload  failures. 

This  is  illustrated  in  Figure  I-la,  b,  c  for  S“3  missions.  Also  shown 
are  the  options  of  launching  satellites  containing  1,  2  or  3  payloads  each. 
Note  that  only  an  initial  deployment  is  represented.  After  failures  have 
occurred  there  may  be  satellites  in  orbit  with  less  than  their  initial  number 
of  operating  payloads.  Replenishment  satellites  could  also  have  1,  2  or  3 
payloads  each. 

A  major  issue  in  the  system  design  is  the  selection  of  the  best  number 
of  payloads  per  satellite.  A  key  factor  in  answering  that  question  is  the 
replenishment  launch  rate.  As  will  be  seen  subsequently,  the  rate  of  payload 
replenishment,  e.g.,  payloads  per  year,  increases  with  the  number  of  payloads 
per  satellite.  This  increase  comes  about  from  a  mismatch  between  the  minimum 
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replenishment  required  (e.g.,  only  Mission  A)  and  the  capabilities  of  the 
replenishment  satellite  (e.g.,  Missions  A  and  B) .  This  increase  could  be 
balanced  by  the  possibility  of  a  reduced  cost  per  payload  pound  of  multi¬ 
mission  satellites  due  to  shared  bus  functions.  (Also  entering  into  the 
decision  would  be  the  increased  cost  per  pound  of  developing  such 
satellites.)  This  paper  will  not  consider  these  economic  issues  further  ^nd 
will  only  address  the  replenishment  launch  rate  issues. 

The  results  to  be  presented  are  felt  to  be  applicable  to  situations 
other  than  maintaining  satellite  systems  on-orbit.  For  example,  consider  a 
grocer  trying  to  maintain  boxes  of  S  types  of  junk  food  on  his  shelves. 

He  might  have  a  choice  of  a  large  number  of  small  (expensive  per  box) 
deliveries  filling  in  just  what  he  needs  or  a  smaller  number  of  larger 
(cheaper  per  box)  deliveries.  He  might  also  have  the  choice  of  ordering  when 
running  low  (replenishment  as  needed)  or  having  a  pre-determined  delivery 
quantity  (scheduled  replenishment).  All  of  these  replenishment  strategies 
will  be  treated. 

The  next  section  treats  the  case  of  scheduled  replenishments,  i.e., 

* 

replenishment  strategies  that  do  not  rely  on  the  status  of  the  systems. 

These  results  are  applicable  to  arbitrary  S  (number  of  resources).  When 
considering  the  more  efficient  strategies  of  replenishing  when  needed 
(including  bulk  replenishment  of  multiple  missions  even  though  only  one 
requires  it)  the  analysis  is  a  good  deal  more  involved.  The  cases  of  S  ■ 
1,2,3  are  treated  in  separate  sections.  An  attempt  will  be  made  to  unify 
results  as  they  accumulate. 


However,  they  are  important  to  consider  because  it  is  not  always  possible 
to  arrange  satellite  launches  on  an  "as-needed"  basis;  launch  dates  are 
often  set  years  in  advance. 
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II.  SCHEDULED  REPLENISHMENT 

A.  General  Considerations 

"Scheduled  replenishment"  refers  to  strategies  by  which  resources  are 
replenished  according  to  some  scheduling  rule  without  regard  to  the  actual 
amount  of  resource  needed.  One  expects  such  strategies  to  result  in  required 
replenishment  rates  greater  than  those  required  by  "replenish  as  needed" 
strategies. 

The  basic  results  of  this  section  apply  to  an  arbitrary  number  of 
systems  (resources)  S  because  the  replenishment  rates  to  be  found  are  really 
per  system. 

It  can  be  shown  in  general  that  the  average  number  of  units  that  will  be 
found  in  service,  N,  is  given  by: 

TT  -  X  r  (II-l) 

where 

X  ■  average  replenishment  rate  (units/time  period). 

L  »  average  lifetime  of  a  unit. 


This  intuitive  relationship  is  an  application  of  Little's  result  [Ref.  1,  pg 
17]  and  is  valid  for  most  replenishment  and  failure  statistics  that  are 
stationary  with  time. 

If  it  is  desired  to  maintain  Nq  units  in  operation  with  fairly  high 

probability  then  the  average  replenishment  rate  will  need  to  be  greater  than 
Nq/  L  because  Eq.  II-l  shows  that  this  rate  would  yield  only  N^  working  units 

on  average.  The  next  sections  explore  this  issue  for  representative  cases. 
One  further  definition  will  be  introduced  now  that  will  be  used  throughout: 


m  - 1/  r 

*  each  unit’s  failure  rate  (per  time  period) 

Further  physical  interpretation  for  M  will  be  given  in  Section  C. 


(II-2) 
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B.  Periodic  Replenishment 

[2] 

Several  years  ago  C.  Niessen  studied  the  periodic  replenishment 
problem.  He  considered  units  that  had  either  expontential  or  uniform 
distributions  for  their  lifetimes.  (He  also  considered  launch  failures  as 
well  as  the  replenishment  of  more  than  one  identical  unit  at  a  time.)  A 
brief  summary  of  his  technique  follows  for  the  case  of  periodic,  single-unit, 
successful  replenishments: 

After  the  K-th  launch  at  time  (K-l)T  the  number  of  surviving  units  N(t) 
can  be  represented  as  a  sum  of  independent  random  binary  variables: 

K-l 

N(t)  *  l  W  (t-jT)  (II-3) 

j-o 

where  T  ■  time  between  launches  and 


!1  if  unit  launched  t-ago  still  survives 
0  if  unit  launched  t-ago  has  failed 

For  exponentially  distributed  unit  life-times 

P  [W(t)  -  1]  -  \  e"yt  t>0  (II-4) 

(  0  t<0 

and  for  uniformly  distributed  life-times 

P  [W(t)  «  1]  -  (  1-pt  0<t<2 

\  2  vT  (II-5) 

\  0  elsewhere 

He  was  then  able  to  calculate  the  probability  distribution  of  N(t).  An 
example  is  shown  in  Figure  (II-l)  for  the  particular  case  of  exponential 
life-times  and  N**4  units  surviving  on  average.  (In  this  particular  example 
the  probability  of  successful  launch  is  0.85.  The  expressions  in  II-4  and 
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Number  Of  Satellites  Launched 


Fig.  II. 1.  Survival  probabilities  for  periodic  replenishment.  Average 
number  of  active  units  ■  4.  Probability  of  successful  launch  *  .85.  F 
Niessen,  Ref.  [2]. 


II-5  can  be  multiplied  by  0.85  to  take  this  into  account.)  The  sawtooth 
nature  of  the  curves  reflects  the  periodic  launch  strategy.  Note  that  in 
equilibrium  the  probability  of  4  or  more  units  operating  successfully  drops 
to  about  0.5  just  before  each  launch.  If  the  desired  number  of  operational 
units  were  4  this  would  not  be  reliable  enough.  Figure  C II— 2)  also  taken 
from  [2]  but  with  N*6  shows  that  this  50Z  increase  in  launch  rate  would  yield 
a  probability  >  0.8  of  maintaining  4  operational  units.  As  will  be  discussed 
in  Section  III,  this  is  50%  above  the  replenishment  rate  that  would  be 
required  for  launching  only  when  needed. 

C.  Poisson  Replenishment/Exponent ial  Lifetime 

An  easier  model  to  work  with  and  one  which  also  could  be  realistic  in 
many  cases  is  that  of  Poisson  replenishment  scheduling  and  exponentially 
distributed  lifetimes  for  each  unit.  The  Poisson  replenishment  scheduling 
physically  (and  roughly)  means  that  replenishment  can  take  place  during  any 
small  interval  of  time  independent  of  previous  or  future  events.  This  model 
leads  to  exponentially  distributed  inter-replenishment  times.  The  same 
interpretation  holds  for  unit  failures  with  exponentially  distributed 
lifetimes.  A  more  complete  description  of  this  system  is  as  follows. 

Let 

X  *  average  replenishment  rate 

and  p  ■  1/L  (II-6) 

*  average  failure  rate  per  unit. 

(Both  of  these  rates  are  with  respect  to  time.)  That  is,  the  probability  of 
replenishing  a  unit  in  a  small  time  interval  At  will  be  \(At)  independent  of 

•ft  a 

time  and  independent  of  the  number  of  surviving  units.  The  probability  that 
a  unit  survives  an  interval  of  time  t  is  e  ^  and  its  probability  of  failure 
is  p(At)  in  interval  At.  The  unit's  average  lifetime  L  is  equal  to 

*  The  replenishment  rate  could  advantageously  be  made  dependent  on  time  if 
the  system's  state  were  known.  This  strategy  can  be  analyzed  but  will  not 
be  pursued  further. 


7 


Number  Of  Satellites  Launched 


Fig.  II. 2.  Survival  probabilities  for  periodic  replenishment.  Average 
number  of  active  units  ■  6.  Probability  of  successful  launch  *  0.85. 
From  Niessen,  Ref  [2]. 


1/u.  If  N  units  are  operational  at  any  time  then  the  probability  of  a 
failure  in  time  At  is  Nu(At).  The  probability  of  more  than  one  failure  in  At 
is  negligible. 

This  replenishment  strategy  can  be  represented  by  the  continuous  time 
Markov  chain  shown  in  Figure  11-3.  (Kleinrock,  Reference  1,  Chapters  2-4 
provides  a  good  reference  for  all  of  the  Markov  process  manipulations  to  be 
performed.)  Each  circle  represents  a  state  of  the  system  which  in  this  case 
is  chosen  to  be  the  number  of  surviving  units.  The  arrows  represent 
transition  rates  which  if  multiplied  by  At  would  give  the  probability  of 
making  the  indicated  transition  in  time  At. 

1.  Equilibrium  Solution 

This  particular  chain  is  seen  to  be  a  birth-death  process  with  a  well 
known  equilibrium  solution:  The  probability,  P  ^  ,  of  being  in  state  j  (that 

is,  having  j  units  in  operation)  is: 


P. 

J 


(X/u)j  -(X/w) 
“jT -  6 


1>0 


(II-7) 


which  is  simply  a  Poisson  distribution.  The  average  number  of  units  in 
operation  will  be 


if 


P. 

J 


-  x/u 


(II-8) 


which  is  a  special  case  of  Eq.  (II-1).  It  is  also  well  known  that  the 
variance  of  the  number  of  units  in  operation  will  be: 


o 


2 

N 


-  X/u 


(II-9) 


which  is  numerically  equal  to  the  average  number. 


This  result  is  valid  for  arbitrarily  distributed  lifetimes. 
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Figure  II-4  shows  the  replenishment  rates  needed  to  maintain  at  least 

operating  units  with  various  degrees  of  confidence.  The  launch  rate  is 
expressed  as  the  normalised  quantity 


average  number  of  units  in  operation 
number  of  units  required 


(11-10) 


The  actual  launch  rate  required.  A,  increases  with  Nq  and  jj,  and  depends  on 

the  confidence  desired.  The  confidence  is  expressed  as  the  probability  that 

at  least  N  units  are  in  operation.  The  figure  shows  that  as  N  increases 
o  o 

the  required  "N  approaches  Nq.  This  happens  for  large  numbers  of  units 

because  the  relative  fluctuation  of  the  number  of  units  around  the  mean  is 

small  and  a  replenishment  rate  about  equal  to  the  failure  rate  (Nqu)  will 

suffice.  At  low  or  moderate  N  ,  however,  replenishing  at  the  average  failure 

o 

rate  is  not  sufficient.  For  example,  to  keep  at  least  Nq“4  units  in 

operation  with  probability  .9  will  require  a  replenishment  rate  sufficient 
to  keep  TT  -  6.7  units  in  operation  on  average.  (Note:  If  it  were  desired  to 
account  for  unsuccessful  replenishments,  the  rate  X  should  be  considered  as 
the  rate  of  successful  replenishments  only.  The  replenishment  process  formed 
by  independent  failures  of  exponentially  scheduled  replenishments  still  has 
an  exponential  distribution.) 

2.  Transient  Solution 

Figures  II-l  and  II-2  show  the  transient  build-up  to  steady-state  for 
two  examples  of  periodic  replenishment.  The  transient  solution  for  Possion 
replenishment  and  exponential  life-times  exhibits  similar  behavior,  but  with 
an  easily  attained  closed  form.  In  particular,  if  units  are  begun  to  be  put 
into  operation  at  time  t*0  at  rate  X,  then  at  time  t,  the  average  number  in 
service,  N(t),  will  be: 


See,  for  example,  Kleinrock  [Ref.  1],  page  82,  problem  2.12. 


and  Che  probability  Chat  j  are  in  service  will  be: 


_  j 

„  /.x  _  WO]  .-N(t)  (11-12) 

jU)  "IT 

which  is  seen  Co  be  a  time-varying  Poisson  distribution  with  Eq.(II-7)  giving 
the  steady-state  values.  The  form  for  1T(t)  shows  that  equilibrium  is  reached 
with  a  time  constant  of  1/p,  depending  only  on  the  lifetisie  of  each  unit. 

If  there  were  Kq  units  in  service  at  time  t*0,  the  number  of  these 
original  units  serving  to  time  t  would  follow  a  binomial  distribution  with: 


P(k  unit s  surviving  out  of  Kq) 


Ko)  e“Mtk  (l-e‘Wt)K°  k  (11-13) 

U/ 


Thus,  the  number  of  units  in  service  at  time  t,  given  Kq  were  in  service  at 
t »0  with  Poisson  replenishment  thereafter  is  the  sum  of  a  binomial  and  a 
Poisson  random  variable.  Using  discrete  convolution,  the  complete  solution 
to  the  probability  of  finding  j  units  in  service  at  time  t  is: 


P  (j  units  at  time  t  |  K  at  t"0) 


III.  REPLENISHMENT  AS-NEEDED,  S-l  SYSTEM. 

To  begin  the  discussion  of  replenishment-as-needed  strategies,  the 

simple  case  of  S*1  system  will  be  considered.  Only  exponential  lifetime 

models  will  be  treated  and  it  will  be  assumed  that  replenishment  takes  place 
★ 

instantaneously. 

Suppose  it  is  desired  to  maintain  Nq  units  in  service,  each  unit  having 

failure  rate  U  (average  lifetime  1/u).  The  required  replenishment  rate  must 

be  equal  to  the  rate  of  failure  generation.  The  rate  of  failure  generation 

will  be  N  u,  N  times  the  failure  rate  of  one  unit.  Again,  letting  X  ■  the 
o  o 

replenishment  rate,  the  fundamental  relationship  is: 

X  *  N  u  (III-l) 

o 

A  proper  derivation  of  III-l  is  as  follows:  Beginning  at  any  time,  a 
replenishment  will  next  be  required  when  any  of  the  Nq  units  in  service 

fails.  The  probability  that  no  replenishment  will  be  required  in  the  next 
time  period  of  duration  t  will  be: 

N 

P  (no  replenishment  in  next  t)  ■  [e  Ut]  0  (III-2) 

which  is  the  probability  that  all  Nq  units  have  survived.  (Note  that  the 

memoryless  property  of  the  exponential  distribution  is  being  fully 
exploited.)  If  the  probability  density  function  of  the  time  to  next 
replenishment  is  denoted  as  pf(t),  then  Eq.  III-2  says: 


In  practical  terms,  it  is  assumed  that  replenishment  is  accomplished  in  a 
time  much  shorter  than  the  average  time  to  the  next  failure.  In  the 
satellite  case  the  number  of  active  units  required,  NQ ,  usually  includes  an 

on-orbit  spare  to  provide  continuity  of  service.  It  is  implicitly  assumed 
that  there  is  an  inventory  of  units  which  will  always  be  able  to  supply  a 
replenishment  unit  when  needed. 
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(m-3) 


/  p  (x)  dx  ■  1-  e  **oWt 
0  r 


and  hence 

pf(t)*  e 


(III-4) 


It  is  seen  immediately  from  (III-4)  that  the  time  to  next  replenishment  is 
exponentially  distributed  with  average  value  1/(Nqu).  This  not  only  verifies 

(III-1)  as  giving  the  average  rate  of  replenishment,  but  shows  that  the 
replenishment  process  is  Poisson.  Specifically,  the  probability  of  requiring 
j  replenishments  in  any  time  duration  T,  P^(T)  will  be: 


Pj(T) 


(N  uT)J 
o 

jT 


-N  JiT 
e  o 


(III-5) 


The  average  number  required  will  be  NqUT  and  the  standard  deviation  will  be 
/  N^pT.  Thus,  taken  over  a  time  period  long  enough  to  average  100 

replenishments  the  standard  deviation  will  be  only  10Z  of  the  average. 
However,  the  relative  fluctuation  in  the  number  of  replenishments  will  be 
much  larger  over  time  durations  averaging  only,  say,  10  or  20  replenishments. 
For  example,  if  the  expected  number  of  replenishment  over  some  time  period  is 
10,  then  there  is  a  21Z  chance  of  requiring  13  or  more  replenishments  which 
is  30Z  more  than  the  average.  Satellite  systems  for  which  the  operational 
usefulness  lasts  through  only  10  or  so  replenishments  must  expect 
considerable  uncertainty  as  to  the  total  number  of  satellites  to  be  procured. 
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IV.  REPLENISHMENT  AS-NEEDED,  S-2  SYSTEMS 

In  order  to  analyze  the  replenishment  as-need  strategy  when  S»2  systems 
are  involved,  it  should  first  be  noted  that  if  each  system  is  replenished 
separately,  e.g.,  one  payload  per  satellite,  then  the  results  of  the  previous 
section  apply  directly. 

The  interesting  case  here  assumes  that  the  units  are  replenished  two-at- 
time  with  one  unit  of  each  type,  i.e.,  no  "doubles".  If  the  two  systems  are 
labeled  A  and  B,  then  if  either  system  requires  replenishment  it  will  be 
assumed  that  an  A  and  B  unit  will  be  provided  even  though  one  of  them  is  not 
needed  at  that  moment.  (In  the  satellite  case  this  is  equivalent  to  saying 
that  all  launched  satellites  are  configured  with  both  payloads  A  and  B.) 

Thus  while  one  system  has  exactly  Nq  units  in  operation,  the  other  one  will 
ha^e  at  least  Nq.  (Only  the  case  where  equal  numbers  of  A  and  B  units  are 

required  will  be  considered  here.  The  models  to  be  presented  would 
generalize  to  unequal  requirements  in  a  straightforward  way.) 

Two  failure  models  will  be  considered: 

Independent  failures  of  all  units 

and 

Dependent  failures  corresponding  to  the  loss  of  a  satellite 
bus  in  addition  to  independent  failures. 

A.  Independent  Failures 

As  applied  to  the  satellite  case,  independent  unit  failures  correspond 

to  considering  only  payload  failures,  ignoring  the  possibility  of  bus 

failures  or  assuming  that  the  bus  failure  rate  is  much  less  than  that  for  the 

payloads.  This  is  illustrated  in  Figure  IV-1  for  N  “4  which  shows 

o 

satellites  carrying  packages  only.  In  some  cases,  the  satellites  have  a 
failed  package  indicated  by  a  blank.  Replenishment  satellites  always  carry 
an  A  and  B  package.  While  there  are  only  4  active  A  packages,  the  example 
shows  two  "excess"  B's  which  are  still  active. 
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Figure  IV-2  shows  how  the  replenishment  system  can  be  modeled  as  a 

Markov  Chain  on  a  2-dimensional  grid.  The  horizontal  axis  gives  the  number 

of  active  A  units  and  the  vertical  gives  the  number  of  active  B  units.  The 

only  allowed  states  are  along  the  L-shaped  path  shown  where  one  or  both 

systems  must  have  exactly  Nq  active  units.  The  failure  rates  for  each  A  and 

B  unit  are  y.  and  y_  respectively.  Note  that  the  chain  is  driven  to  the 
A  D 

right  ("excess"  A's)  by  failures  in  the  N  B  units  which  are  active  and 

o 

driven  upwards  by  failures  in  the  A  units. 

•Hf 

The  state  probabilities  ,  P(j,k),  are  readily  found  by  using  the  well- 
known  techniques  applied  to  one-dimensional  birth-death  queues  in  equilibrium 
[1,  Chapter  3],  In  particular,  the  rate  of  crossing  a  dividing  line  between 
two  states  must  be  equal  in  both  direction  while  in  equilibrium. 

For  example, 


<Vi>i*A  p<No*J'  »„>  ■  »„>  i>0 


(IV-1) 


rate  left 


rate  right 


Using  P(N  ,  N  )  as  the  starting  point  gives: 
o  o 


P(N  +j,  N  )  -  (Ny„/yA)j  PC*  ,  N  ) 


and 


o  B  "A' 

n  <Vk) 

kSl  ° 


o  o 
j>0 


(IV- 2a) 


N„+j)  "  ("oW  P(No’  No) 


o  o 


J,  <Ho*k) 

k"  1 


j>0 


(IV- 2b) 


That  is,  the  probability  of  having  j  A  units  and  k  B  units  active. 
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Fig.  IV. 2.  State  diagram  representing  independent  failures,  replenishment 
two-at-a-time. 


1 


(These  expressions  d**  not  appear  to  reduce  to  more  elemental  forms.)  The 
value  of  P(Nq,  N  )  is  found  by  requiring  that  the  state  probabilities  sum  to 

unity. 

Once  the  state  probabilities  are  known  then  other  important  questions 
can  be  answered.  For  example,  the  average  required  replenishment  rate  will 
be: 


X  -  H  U  I  P(» c*j,  H0>  *  «0»k  I  ta  *  *  k)  (IV-3) 

j“0  k*0 


which  is  found  by  examining  the  conditional  launch  rate  for  each  state.  The 
average  number  of  A  units  exceeding  the  required  value  of  will  be: 


average  "excess"  A's  ■  EA 


l  i  »0) 

J-0 


( IV-4 ) 


with  a  similar  expression  for  the  average  excess  B's,  E^. 

The  case  of  equal  failure  rates  will  be  examined  next  as  a  special  case. 


1.  Equal  Failure  Rates. 

First,  let  yA  ■  y  ■  U.  Figure  IV-3  gives  some  numerical  results 

A  B 

for  four  parameters: 

a.  X/yN  is  the  normalized  average  replenishment  rate  from  Eq. 
o 

IV-3.  Recall  that  each  replenishment  consists  of  an  A  and  B  unit.  If  units 
were  replaced  individually  the  replenishment  rate  would  be  NQy  (See  Eq.  III- 

1)  for  each.  It  can  be  seen  from  the  figure  that  this  ideal  is 
asymptotically  reached  only  for  large  Nq.  When  Nq  is  moderate,  around  5  for 
example,  the  average  rate  is  1.2  N^y  which  is  an  increase  of  20%  over  the 

minimum  possible.  This  is  due  to  the  fact  that  excess  units  of  one  type  must 
be  placed  in  service  because  a  circuit  of  the  other  type  has  failed. 
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b.  (E.+  E_)/N  is  the  normalized  expected  number  of  "excess" 

A  B  o 

units  of  either  type  in  service  from  Eq.  IV-4.  Only  one  unit  will  have 

excesses  at  any  particular  time  so  this  figure  is  the  average  number  that 

would  actually  be  observed.  (Over  the  systems'  lifetimes,  each  would  exhibit 

one  half  of  the  excesses.)  The  normalized  excess  is  seen  to  decrease  with  N  . 

o 

However  for  moderate  N  "  4  or  5.  there  will  be  about  40Z  excess  units  of  one 

o 

type  or  the  other  found  in  service. 

c.  P(N  ,  N  )  is  the  probability  that  both  systems  are  "critical", 

o  o 

i.e.,  they  both  have  only  Nq  units  in  service.  When  in  this  state  the 

average  time  to  next  replenishment  is  l/(2Nou),  whereas  in  all  others  it  is 

1/N^u.  The  figure  shows  that  the  fraction  of  time  in  this  state  decreases 

with  N  . 
o 

d.  (Run)u  is  the  normalized  average  time  the  system  will  have  a 

run  of  either  excess  A's  or  B's.  (It  is  normalized  by  the  unit  lifetime, 

1/u.)  This  is  described  as  follows:  Suppose  the  system  is  in  the  (Nq,  Nq) 

state  with  A  and  B  critical.  If  an  A  unit  were  to  fail,  the  replenishment 

needed  would  put  B  in  excess.  The  system  will  remain  with  B  in  excess  until 

the  next  time  (N  ,  N  )  is  reached.  This  time  in  excess  is  being  called  a 

o  o 

run.  It  gives  an  indication  of  how  long  it  takes  to  flush  excess  units  out 
* 

of  the  system.  The  figure  shows  that  the  average  run  time  decreases  with  Nq 

and  is  always  less  than  the  lifetime  of  a  single  unit,  but  may  last  for  many 

average  replenishment  times.  It  is  found  as  follows: 

At  any  time,  the  system  will  either  be  in  state  (Nq,  Nq)  or  in  a  run.  The 

fraction  of  time  the  system  is  in  state  (N  ,  N  )  is  just  P(N  ,  N  );  the 

o  o  o  o 

fraction  of  time  spent  in  all  runs  is  l-P(No>  Nq).  Each  time  the  system 

leaves  (or  enters)  state  (Nq,  Nq)  a  run  is  begun  (or  ended).  Thus  if  the 

system  is  observed  over  some  long  time  period  T  the  expected  total  time 

spent  in  (N  ,  N  )  can  be  written  as: 
r  o’  o 

•ff 

Note  that  the  average  number  of  excess  units  during  a  run  is  equal  to  E^  or 
Eg  divided  by  the  probability  of  being  in  an  excess  of  A  or  B  run 
respectively. 
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expected  total  time  in  (N  ,  N  )  (IV-5) 

o  o 

*  (expected  4  of  runs)  (expected  time  to  be  held  in  (Nq,  Nq)) 


Two  of  the  three  terms  can  be  substituted  with  other  expressions: 


Thus , 

Since 


T  P(N  ,  N  )  *  (expected  #  of  runs)  (1/2N  p) 
o  o  o 


expected  #  of  runs  ■  2N  pT  P(N  ,  N  ) 

o  o  o 


expected  total  time  in  runs 

*  (expected  #  of  runs)  (expected  run  length) 

-  T(1-P(N  ,  N  )) 
o  o 


( IV-6 ) 
(IV-7) 


(IV-8) 


it  is  found  that 

expected  run  length  ■  Run 

!-  P(»o,  Ho) 

”  2N~(i  P(N  ,  N  ) 

o  o  o 

The  curve  of  Figure  IV-3d  results. 


(IV-9) 


2.  Unequal  Failure  Rates 

If  one  of  the  units  is  less  reliable  then  it  will  have  a  higher 
failure  rate.  Suppose  A  is  less  reliable  so  that 


Figure  IV-4  gives  some  numerical  results  illustrating  the  effects  of 

imbalanced  failure  rates.  The  curves  are  plotted  versus  the  ratio  of  failure 

rates  P./p_  for  a  few  values  of  N  . 

An  o 
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(a)  Probability  of  Excess  B 


(b)  Average  Replenishment  Rate 


(c)  Average  Excess  B  Units 


1 1 1 9838-N  | 


Fig,  IV. 4.  Results  for  dual  replenishment  with  independent  failures 
(unequal  failure  rates). 


a.  ?[Excess  B]  is  the  probability  that  there  is  at  least  one 

excess  B.  As  p  /p  increases  this  probability  approaches  unity  since  the 
A  D 

less  reliable  A's  are  forcing  unnecessary  replenishments  of  B  units. 

b.  X/N  p  is  the  replenishment  rate  normalized  by  the  failure 

O  D 

rate  of  B's.  When  p^/pB  is  large  enough  the  replenishment  rate  will  be 

dominated  by  the  failures  in  the  A  units  and  X  will  approach  N  p  .  Thus 

O  A 

X/N  p  will  approach  p./p  as  shown  in  the  figure. 

O  d  Ad 

c.  E  /N  is  the  expected  number  of  excess  B  units  normalized  by 

o  O 

N  .  The  expected  number  of  B  units  in  service  is  X/p„.  As  p./p_  increases 
O  BAB 

this  will  approach  N  (p./p  ).  Hence  the  expected  normalized  excess  number  of 

O  A  D 

B  units  will  approach  (w^/Ug_l)  as  indicated.  The  number  of  excess  A  units 
approaches  zero  since  they  are  almost  always  in  critical  supply. 

B.  Including  Satellite  Bus  Failures. 

Figure  1-1  illustrated  the  point  that  satellites  are  constructed  with 
the  payload  units  mounted  on  a  bus.  In  addition  to  the  payload  unit  failures 
which  were  treated  in  the  Last  section,  the  effects  of  bus  failures  will  now 
be  included.  At  any  time,  satellites  with  three  combinations  of  working 
units  may  be  found  on-orbit: 

Type  AB  with  both  payloads  and  the  bus  operating. 

Type  A  with  only  payload  A  and  the  bus  operating  (B  having  failed) 
Type  B  with  only  payload  B  and  the  bus  operating  (A  having  failed) 

(In  addition,  of  course,  there  would  be  useless  dead-wood  consisting  of 
satellites  with  failed  buses  and/or  both  A  and  B  packages  that  have  failed.) 

The  state  of  the  system  can  be  characterized  by  a  triplet  of  numbers 
indicating  the  number  of  each  type  of  useful  satellite  remaining.  An 
enumeration  of  the  states  as  well  as  the  transition  rates  among  them  is  shown 
in  Figure  IV-5  in  which  the  desired  number  of  working  units,  Nq,  is  equal  to 
2.  Each  state  is  labeled  with  the  number  of  type  AB,  type  A,  and  type  B 
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Fig.  IV. 5.  State  diagram  including  bus  failures  (NQ 
required ) . 


2  active  units 


I 


satellites.  The  transition  rates  are  given  in  terms  of  the  package  failure 
rates,  ti^  and  as  well  is  the  bus  failure  rate,  Ugug>  It  is  assumed  that 
failures  of  the  packages  and  buses  occur  independently.  The  figure  shows 
only  the  upper  half  of  the  state  diagram,  including  just  those  states  with 
both  systems  critical  or  excess  B’s  (equivalent  to  those  states  with  exactly 
2  working  A's).  It  should  be  clear  how  to  extend  it  symmetrically  to  excess 
A's. 

Figure  IV-6  is  an  annoted  example  of  the  transitions  from  one  of  the 

states,  (1,  1,  2),  also  showing  which  transitions  are  concomitant  with  a 

replenishment  launch  (not  all  of  them  are).  It  should  also  be  noted  that 

there  is  a  self-loop  that  occurs  if  the  bus  of  the  type  AB  satellite  fails. 

The  state  would  not  change  but  a  replenishment  would  be  required.  This 

occurs  at  rate  y_ 

Bus 

The  equilibrium  state  probabilities  fo  the  system  shown  in  Figure  IV-5 
were  found  using  standard  Markov  chain  techniques  [Ref.  1,  Section  2.4].  The 
approach  is  given  briefly  as  follows: 

First  number  the  states  (in  any  order).  Then  define  the  elements  q^  of 
the  matrix  transition  rates  Q  as  follows: 


transition  rate  from  state  i  ♦  state  j 


i*j 


(IV-10) 


Then  putting  the  state  probabilities  ?.  into  row-vector  form,  P,  the 
following  linear  matrix  equation  and  normalizing  condition  will  yield  the 
solution  for  P: 


However  another  interpretation  of  bus  failure  is  that  of  an  entire 
satellite  failure,  or  failure  of  function  needed  by  the  other  packages, 
e.g.,  a  cross-link,  or  that  of  non-independent  package  failures.  The 
appropriate  interpretation  depends  on  the  application. 
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Fig.  IV. 6.  Annotated  transition  rates  from  state  (1,  1,  2).  (*  indicates 

replenishment  required.) 


PQ  -  0 


(IV-11) 


The  matrix  equation  is  nothing  more  than  the  equilibrium  "rate-in  equals 
rate-out"  condition  for  each  of  the  states. 

These  equations  were  solved  for  the  system  of  Figure  IV-5  by  first 
truncating  the  number  of  states  to  those  shown  plus  the  symmetrical  lower 
ones.  Only  the  case  Mg  *  M^  was  considered.  The  probability  of  reaching  the 
extreme  states  turned  out  to  be  less  than  .05,  showing  that  the  truncation 
did  not  significantly  disturb  the  results  to  follow. 

Figure  1V-7  shows  two  key  numerical  results.  Both  are  plotted  versus 
the  parameter  p  “  Fgug/(p^+  Ugug)  which  is  an  indication  of  the  relative 
failure  rates  of  the  bus  and  each  package.  When  p*0  it  is  equivalent  to  no 
bus  failures,  the  case  treated  in  the  previous  section.  When  equal  to  one, 
the  only  failures  are  bus  failures  (or  simultaneous  package  failures). 

a.  X/Nq(u^  +  FBu8)  is  the  normalized  expected  replenishment  rate. 
yA  +  ^Bus  can  tllou8ht  88  the  mission  failure  rate  for  each  payload 
caused  by  either  a  payload  or  bus  failure.  When  p-0  the  result  is  the  same 
as  the  previous  section's  (see  Figure  IV-3a).  When  p-1  the  replenishment 
rate  exactly  matches  the  bus  failure  rate,  Nq Mgug ,  which  will  imply  1002 
effective  replenishment  of  failed  resources  with  no  build  up  of  excesses. 

X  is  calculated  by  examining  the  conditional  launch  rate  of  each  state, 

weighting  it  by  the  state's  probability  and  summing.  The  conditional  launch 

rate  for  all  states  where  only  A  is  critical  is  2(m.  +  ).  The  launch 

A  Bus 

rate  for  those  states  where  A  and  B  are  both  critical  ((2,  0,  0),  (1,  1,  1) 
and  (0,  2,  2))  is  2m^  +  2Vg  +  (#  of  buses )Mgug. 

b.  Eg/No  *8  t*ie  expected  normalized  excess  number  of  payloads  of 
either  type  that  would  be  found.  As  shown  it  is  maximum  when  p*0,  indicating 


29 


H  '  Ma  +  Mbus 
(b)  Average  Excess  (Normalized) 

Fig.  IV. 7.  Results  for  duel  replenishment  including  bus  failures  (equal 
package  failure  rates).  N_  ■  2. 


independent  failures  allowing  excesses  of  one  type  or  another  to  build  up. 
When  p-1  no  excess  units  build  up  because  all  failures  are  double  failures, 
replenished  efficiently  by  just  the  right  number  of  new  units. 

The  reader  should  see  how  to  generalize  to  other  values  of  N  or 
.  .  o 

differing  y^  and  y^:  It  is  a  question  of  careful  bookeeping  to  account  for 

the  allowed  state  transitions.  The  qualitative  nature  of  the  results  should 

also  be  clear. 

It  also  should  be  noted  that  the  transient  behavior  can  be  found.  In 
particular  if  the  state  of  the  system  at  time  t*0  is  known,  the  probability 
row  vector  at  time  t  will  be: 

P(t)  *  P(0)e^  (IV-12) 

where  P(0)  is  the  probability  row  vector  at  t«0.  (The  usual  definition  of 
matrix  exponentiation  is  being  used.) 
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V.  REPLENISHMENT  AS-NEEDED,  S-3  SYSTEMS 

When  dealing  with  S*3  systems,  (labeled  A,  B  and  C) ,  the  units  can  be 
replenished  one,  two  or  three  at-a-time.  (Only  replenishment  as-needed 
strategies  are  treated  here.  Scheduled  replenishment  was  treated  in  Section 
II.) 

If  replenished  one  at  a  time,  then  according  to  Eq.  (III-1),  the 
replenishment  rate  will  be  equal  to  NqP,  where  Nq  *  the  number  of  active 
units  maintained  and  p  *  the  failure  rate  per  unit.  (These  parameters  need 
not  be  the  same  for  each  system.) 

Replenishing  two-or-three-at-a-time  is  considerably  more  involved. 

While  Markov  chain  models  can  be  developed  that  take  into  account  bus 
failures,  differing  unit  failure  rates,  differing  active  unit  requirements 
and  differing  strategies  for  deciding  which  excess  units  should  be  added, 
only  some  simplified  cases  will  be  examined  here.  The  simplifying 
assumptions  to  be  used  are: 

1. )  the  same  number  of  active  units  are  required  in  each  system  and 

will  be  denoted  as  N  . 

o 

2. )  the  failure  rate  per  unit  is  the  same  for  each  system  and  will 

be  denoted  as  p 

3. )  unit  failures  occur  independently  and  with  exponential  distribution 

for  their  lifetime  (average  lifetime  *  1/p  per  unit). 

4. )  no  "bus"  failures  are  considered. 

5. )  replenishing  three-at-a-time  always  includes  one  of  each  type  of 

unit,  e.g.,  only  ABC  never  ABB. 

and  6.)  replenishing  two-at-a-time  always  includes  units  of  two  different 

types,  e.g.,  AB  is  allowed  but  AA  is  not. 

With  these  assumptions,  the  three-at-a-tirae  and  two-at-a-time  solutions 
will  now  be  presented. 
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A.  Replenishing  Three-at-a-Time 

When  replenishing  three-at-a-time,  new  units  A,  B  and  C  will  be  placed 

in  service  when  the  number  of  units  of  any  one  system  drops  below  Nq.  While 

the  state  of  such  a  system  could  be  taken  as  the  number  of  A,  B  and  C  units 

in  service  there  is  another  representation  that  requires  fewer  states.  It  is 

sufficient  to  know  the  count  of  the  three  types  of  units  without  regard  to 

which  unit  is  associated  with  which  count.  For  example  if  one  system  has 

another  has  N  +1  and  the  third  N  +3.  this  state  specification  would 
o  o 

actually  represent  any  of  the  6  ways  to  assign  these  counts  to  systems  A,  B, 
C.  This  state  will  be  labeled  (0,  1,  3)  indicating  the  number  of  units  in 
excess  of  Nq .  (One  of  the  terms  must  always  be  zero.  Even  though 
superfluous,  it  will  be  carried  along  as  a  reminder.)  The  counts  will  always 
be  shown  in  non-decreasing  order.  This  simplification  will  be  valid  because 
the  failure  rates  for  the  units  are  the  same  as  are  the  number  of  required 
active  units  for  each  system. 

Figure  V-l  shows  the  Markov  chain  model  using  the  state  definition  just 

described.  The  transition  rates  are  shown,  omitting  the  factor  of  p  that 

multiplies  each  value.  The  transitions  marked  with  an  asterisk  are  those 

associated  with  a  replenishment.  The  conditional  replenishment  rate  for  each 

state  is  N  p  times  the  number  of  counts  that  are  at  zero  excess, 
o 

In  order  to  solve  this  probabilistic  system  it  was  turned  into  a  finite 

Markov  chain  by  allowing  up  to  only  M  excess  units  of  any  type.  Any  units  in 

excess  of  M  are  permanently  lost.  For  M*3  this  is  equivalent  to  redirecting 

the  downward  transitions  from  the  bottom  row  of  Fig.  V-l  to  the  left  (and 

eliminating  the  downward  transition  from  (0,  3,  3)).  Then  the  procedure 

outlined  in  Section  IV  could  be  applied.  After  solving  for  the  state 

probabilities  the  replenishment  rate  was  calculated  and  it  is  shown  in  Figure 

V-2  normalized  by  N  p  versus  N  for  values  of  M  from  3  to  6.  The 

o  o 

replenishment  rate  is  that  for  each  unit  to  facilitate  comparisons  with  the 
one  or  two-at-a-time  cases.  In  the  three-at-a-time  case  the  package 
replenishment  rate  is  equal  to  the  bulk  replenishment  rate  since  each 
replenishment  contains  one  of  each  type  of  unit. 
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The  curves  show  Chat  as  Nq  grows,  Che  replenishment  process  becomes  more 

efficient  with  the  normalized  rate  heading  toward  its  minimum  possible  value 

of  unity.  (This  is  achieved  only  with  one-at-a-time  replenishment.)  Also, 

as  the  number  of  allowed  excess  units  increases  the  replenishment  efficiency 

becomes  better  because  there  are  fewer  wasted  spares.  For  Nq  up  to  about  10 

the  numerical  results  show  that  there  will  be  little  reduction  in  the 

required  replenishment  rate  even  if  larger  M  were  allowed.  For  example,  for 

N  *5  the  probability  of  ever  having  6  or  more  active  spares  of  any  unit  will 
o 

be  less  than  .05  showing  that  increasing  M  beyond  6  will  have  little  effect. 

B.  Replenishing  Two-at-a-Time 

The  two-at-a-time  curve  in  Figure  V-2  was  found  in  a  similar  manner  from 

the  state  diagram  of  Figure  V-3.  The  state  notation  is  the  same  as  Figure  V- 

1.  The  replenishment  is  as  follows:  If  the  unit  count  for  any  system  drops 

below  the  critical  value  of  a  replenishment  is  performed  consisting  of  a 

replacement  for  the  failed  unit  plus  a  unit  of  the  system  remaining  with  the 

lower  count.  For  example  suppose  there  are  Nq  A-units,  Nq+  1  B-units  and 

N  +2  C-units  (state  (0,  1,  2)).  If  a  B  or  C  unit  fails  no  replenishment  is 
o 

required.  However  if  an  A  unit  fails  a  replenishment  will  be  arranged  with 
an  A  and  B  unit  sending  the  system  to  state  (0,  2,  2).  This  transition 
happens  with  rate  N^u. 

The  bulk  replenishment  rate  is  calculated  in  an  identical  way  to  the 
three-at-a-time  strategy.  This  is  the  rate  of  required  replenishments  of  any 
type.  In  satellite  terminology  this  would  be  the  required  launch  rate.  For 
the  two-at-a-time  strategy,  however,  the  replenishment  rate  per  system  will 
be  2/3  of  the  bulk  rate,  since  on  the  average  each  unit  type  will  appear  on 
on  only  2/3  of  the  replenishments.  The  replenishment  rate  per  system  is 
shown  in  Figure  V-2. 

The  calculation  was  performed  allowing  a  maximum  of  4  spare  (above  Nq) 
units.  However  the  results  showed  that,  even  with  N^^lOO  units  required,  the 
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If  the  two  remaining  systems  have  the  same  count  a  random  choice  is  made. 


probability  of  having  4  or  more  spare  units  is  less  than  .02.  Thus  the  two- 
at-a-time  curve  appears  valid  even  if  unlimited  spares  were  allowed. 

Once  again  it  is  seen  that  with  larger  Nq  required  the  resulting 

replenishment  is  done  with  greater  efficiency.  It  is  also  clear  that  two-at- 
a-t ime  replenishment  is  more  efficient  than  three-at-a-time  replenishment. 
This  is  expected  since  assets  are  being  placed  into  service  with  a 
distribution  more  closely  matching  the  failure  patterns.  The  most  efficient 
is,  of  course,  to  replenish  only  the  units  that  have  failed  one-at-a-time. 

It  is  important  to  remember  that  replacement  rate  is  not  the  only 
criterion  on  which  to  base  a  replenishment  strategy.  It  is  the  overall  cost 
that  must  be  considered.  In  particular,  for  satellite  applications,  the  cost 
of  replacing  a  payload  with  a  single  mission  satellite  could  be  more  than  1/2 
or  1/3  of  the  cost  of  two-at-a-time  or  three-at-a-time  replenishment  because 
of  shared  overhead  functions  for  multi-mission  satellites.  On  the  other  hand 
the  mission  failure  rates  (bus  plus  package)  for  multi-mission  satellites  may 
be  greater  due  to  increased  complexity. 

C.  Bus  Failures. 

While  no  detailed  analysis  of  the  type  done  in  Section  IV-B  for  2 
systems  including  bus  failures  has  been  done,  there  are  some  observations 
that  can  be  made.  Suppose  that  the  only  failures  were  due  to  bus  failures. 
Then  the  bulk  replenishment  (launch)  rates  would  be  as  follows: 

X  *  3N  (1)  one-at-a-time 
o  Bus 

3N 

~mT'  UBua*2^  two-at-a-time 

S  |i,  (3)  three-at-a-time 

o  Bus 

whre  (k)  "  ^us  failure  rate  for  k-at-a-time  replenishments.  The  launch 

rate  per  system  normalized  by  the  mission  failure  rate  and  the 

number  of  units  required  all  turn  out  to  be  the  same,  unity. 


The  greatest  spread  in  replenishment  rates  (normalized  by  mission 
failure  rates)  among  the  three  strategies  will  be  for  the  case  of  independent 
(no  bus)  failures  and  equal  unit  failure  rates.  This  is  shown  in  Figure  V-2. 


VI.  CONCLUSIONS 


Both  scheduled  and  as-needed  replenishfient  strategies  were  analyzed  for 
multiple  resource  systems.  It  was  found  that  in  general  Che  most  efficient 
strategies  are  those  for  which  the  replenishment  is  made  with  a  combination 
of  units  most  closely  resembling  the  failed  resources.  In  this  context, 
"most  efficient"  refers  to  the  smallest  expected  unit  replenishment  rate 
required  to  guarantee  a  given  level  of  continuing  service.  Quantitative 
results  were  given  for  many  cases  of  interest.  The  techniques  used  can  be 
extended  to  other  replenishment  strategies  and  failure  models. 

The  results  are  particularly  applicable  to  multi-mission  satellite 
systems  and  form  a  major  element  in  the  economic  analysis  of  such  systems. 
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